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DETAILED ACTION 

Applicants' response to the last Office Action, filed on December 19^, 2007 has been 
entered and made of record. 

Applicants' amendment to the claims to include the limitation that the pen stylus is "non- 
electronic" has required new grounds of rejection. New grounds of rejection are therefore 
presented in the Office Action. 

Response to Arguments 

1 . Applicant's arguments, see applicants', filed 12/19/2007, with respect to the rejection(s) 
of claim(s) 1-25 under Pittel and Schiller. 

With regards to the arguments towards the amended subject matter see the rejections below, 
wherein Pittel teaches the use of a non-electronic stylus in paragraph 0028. 
Furthermore, Applicants argue that Pittel teaches the use of the camera and stylus device for 
handwriting and tilt recognition without a touch screen. Examiner agrees that Pittel teaches the 
use of a non-touch screen surface, but that is only because Pittel is teaching a method for 
handwriting and tilt recognition without needing a touch sensitive screen. However, Examiner is 
not arguing that the two prior art references teach the limitations of claim 1 separately, but in 
combination. Pittel is being used to teach an alternative method of measuring the tilt of a pen 
that can be used on a mobile device. Schiller is being used to teach the use of a touch screen 
device and handwriting recognition utilizing touch screen and pen tilt information. The 
substitution of a known method as taught by Schiller for a known alternative method of 
gathering the tilt information as taught by Pittel would have been obvious to one of ordinary skill 
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in the art to yield the predictable result of utilizing tilt information with handwriting recognition. 
Furthermore, Pittel is not being relied upon to teach handwriting recognition using a touch 
sensitive device. 



Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 1-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over Schiller (US 
2002/0031243) in view of Pittel (US 2003/0095708). 

Instant claim 1 : A dynamic handwriting recognition system for a pervasive device comprising: 
a touch screen device [Schiller paragraphs 0032-0035 teaches the use of a touch screen device 

(digitizing pad) on a PDA]; 

a stylus means enabling a user to write on said touch screen, said touch screen generating 
dynamic information associated with stylus writing [Schiller teaches the use of the touch screen 
to generate dynamic handwriting information in combination with a stylus means is inherent for 
a touch screen device such as is described for use in Schiller which requires the generation of a 

signature.}; 

a digital image capture means mounted in said pervasive device for obtaining images of said 
stylus as said user writes on said touch screen; means for processing said obtaining images and 



Application/Control Number: 1 0/7 1 9,705 Page 4 

Art Unit: 2624 

extracting non screen-related information associated with stylus manipulation by said user 
{Schiller teaches the use of handwriting information generated by the touchpad in combination 
with non touchpad information in paragraph 0060 (tilt information) to increase the accuracy of 
the recognition. However, Schiller does not teach the measuring or processing of this data with 
an attached camera device. However, Pittel: Teaches in Fig. 1-2, 7-8, 11, paragraphs 0003, 
0004 (tilt of pen relative to writing surface), 0026, the use of a digital camera on a mobile device 
(such as a PDA see beginning of paragraphs 0004 and 0026) to perform handwriting 
recognition. Also, in paragraph 0004 Pittel teaches the measurement of the tilt of the writing 
element, which is known as taught by Schiller to increase the accuracy of the handwriting 
recognition. Thus it would have been obvious to one of ordinary skill in the art to combine the 
teaching of Schiller with Pittel to substitute the pen based tilt measurement referred to in Schiller 
with a known camera based technique as taught by Pittel to yield the predictable result of 
determining the handwriting using touch-pad and tilt information. Furthermore. Pittel teaches 
in paragraph 0022 that a camera provides a real time approach and an increased signal to noise 
ratio thus providing up to date accurate readings, and in paragraph 0028 states that the pen can 
be electronic or non-electronic and thus Pittel teaches the use of a non-electronic stylus.]; 
and handwriting recognition means receiving both said dynamic touch screen information and 
extracted non touch screen-related information from said processed images for recognizing 
writing of said user, wherein improved handwriting recognition is achieved [See the rejection 
above. Schiller teaches the utilization of touch-pad handwriting recognition information as well 
as tilt information. Pittel teaches the measuring of tit information using an alternative method 
(camera).]. 
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Instant claim 2: The dynamic on-line handwriting recognition system as claimed in claim 1, 
wherein said extracted non screen-related information include tilt parameters associated with 
stylus manipulation [See the rejection of claim 1 wherein both Pittel and Schiller teach the 
advantage of stylus tilt parameters.]. 

Instant claim 3: The dynamic handwriting recognition system as claimed in claim 1, wherein said 
pervasive device comprises a Personal Digital Assistant (PDA) device [Pittel discloses the use of 
the camera on a portable electronic device in paragraph 0004 and Schiller in paragraph 0035 
teaches a PDA.]. 

Instant claim 4: The dynamic handwriting recognition system as claimed in claim 2, further 

including a touch screen control device for generating coordinates of said stylus writing upon 
said touch screen [The generation of coordinates is an inherent part of handwriting recognition 
on a touch screen display. Furthermore, see paragraph 0060 of Schiller wherein the x,y vector 
data is used, and one of ordinary skill in the art understands that vectors have a direction, 
magnitude, and coordinate positions.] 

Instant claim 5: The dynamic handwriting recognition system as claimed in claim 2, wherein said 
digital image capture means obtains images in a plane perpendicular to a plane defined by said 
touch screen device [Pittel Fig. 1 and 2]. 
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Instant claim 6: The dynamic handwriting recognition system as claimed in claim 4, wherein said 
pervasive device implements pattern recognition means for extracting said non touch screen- 
related pen information [Pittel: paragraph 0004 "The software is configured to apply pattern 
recognition to signals from the digital cameras"^. 

Instant claim 7: The dynamic handwriting recognition system as claimed in claim 6, wherein said 
stylus means includes elements enabling recognition by said pattem recognition means [Pittel: 
Fig 7 paragraph 0065 "The black (or other colored) tip of the marker would then be 
automatically tracked by the same phone and camera ". Furthermore, it has been known to one 
of ordinary skill in the art to track an object based on its own properties or a particular pattern 
(i.e. pattern recognition) placed on the object.]. 

Instant claim 8: The dynamic handwriting recognition system as claimed in claim 7, wherein said 
elements enabling pattem recognition includes colored segments in a structure known to said 
pattem recognition means {Pittel: As per rejection of instant claim 8 the tip can be black or 
colored hence distinguishing it from the lighter colored writing surface by the different color 
segments.]. 

Claims 9-16 describe the method performed by the system of claims 1-8, and as per rejection of 
claims 1-8 the system has been shown to be within the knowledge of "one of ordinary skill in the 
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art". Furthermore, since the system performs the described method then the method was also 
known to one of ordinary skill in the art at the time of the invention. 



Instant claims 17-20: The limitations of instant claims 17-20 are encompassed by the limitations 
of instant claims 1-2 and 4-5. Thus instant claims 17-20 are rejected as per the rejections of 
instant claims 1-2 and 4-5. 

Instant claims 21-23: The limitations of instant claims 21-23 are encompassed by the limitations 
of instant claims 6-8. Thus instant claims 21-23 are rejected as per the rejections of instant 
claims 6-8. 

Conclusion 

4. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 

Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi-om the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
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however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 



Contact Information 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nathan Bloom whose telephone number is 571-272-9321 . The 
examiner can normally be reached on Monday through Friday from 8:30 am to 5:00 pm (EST). 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, Samir Ahmed, can be reached on 571-272-7413. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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/Samir A. Ahmed/ 

Supervisory Patent Examiner, Art Unit 2624 



